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METHOD AND APPARATUS FOR PROVIDING RELIABLE GRAPHIC 
MEMORY OPERATIONS IN A SET-TOP BOX ENVIRONMENT 

BACKGROUND AND SUMMARY OF THE INVENTION 

The present invention relates generally to computer video memory management and 
more particularly to computer video memory management in a set-top box television 
environment. 

Graphic applications require a certain amount of graphic/video memory in order to 
smoothly perform their graphic routines. However, video memory is at a premium within 
the set-top box television environment. For example, a set-top box may have approximately 
two megabytes of video memory. MPEG (Moving Pictures Experts Group) components in 
some situations consume 1812 kilobytes, leaving only 236 kilobytes for graphic applications. 
Certain high resolution graphic applications utilize 600 kilobytes for sixteen bits per pixel 
or 300 kilobytes for eight bits per pixel. Accordingly, the disadvantage ensues that graphic 
applications quickly run out of memory to smoothly perform their operations. 

The present invention is directed to overcoming this disadvantage and other 
disadvantages. In accordance with the teachings of the present invention, a video memory 
handling system provides a graphic computer-implemented process with a predetermined 
amount of video memory to be used by the graphic process to perform a predetermined 
graphic-related operation within a set-top box environment. A first video memory portion is 
provided which has an allocation status with respect to the graphic process. A video memory 
handling data structure indicates the allocation status of the first video memory portion. A 
video memory manager which is connected to the video memory handling data structure 
reallocates the first video memory portion based upon the video memory handling data . 
structure. The reallocated first video memory portion is utilized by the graphic process to 

1 



WO 00/40004 PCT/US99/30245 

perform the predetermined graphic-related operation. 

Advantages of the novel handle-based system of the present invention include 
handles of video memory portions being lockable, movable, purgeable, and having priorities. 
These characteristics are useful, for example, in implementing a garbage collection scheme 
that allows re-allocating the memory of non-locked, purgeable, low priority handles as well 
as the memory associated with those handles which have been least recently used. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Additional advantages and features of the present invention will become apparent 
from subsequent description and the appended claims, taken in conjunction with the 
accompanying drawings wherein the same reference numeral indicates the same parts: 

Figure 1 is a perspective view of a set-top box system; 

Figure 2 is a block diagram depicting the various exemplary programs operating 
within the set-top box system of Figure 1 ; 

Figure 3 is a block diagram depicting the components of the present invention for 
allocating video memory via handles; 

Figure 4 is a data structure diagram depicting the preferred embodiment for the video 
memory handling data structure; 

Figures 5a-5d are exemplary data structure implementations of the data structure 
diagram of Figure 4; 

Figure 6 is a flowchart depicting the process steps for allocating video memory via 
handles; 

Figure 7 is a memory organization diagram illustrating system and video memory 
portions; 

Figure 8 is a memory organization diagram illustrating managed and unmanaged 

2 



WO 00/40004 



PCT/US99/30245 



video memory portions; 

Figure 9 is a memory organization diagram illustrating memory blocks and chunks; 

and 

Figure 10 is a memory organization diagram illustrating a creation of a sub-heap from 
a block of memory. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Figure 1 shows an exemplary set-top box 20 connected to television 24 via cable 28. 
Cable 32 provides set-top box 20 with a broadcast analog, broadcast digital, and interactive 
digital transmission. Set-top box 20 contains application and operating system software in 
order to provide an advanced interactive television environment. The operating system is 
utilized by set-top box 20 to, for example, provide interfaces between the application 
software and the various devices used by the set-top box 20. 

Figure 2 depicts the software components of a set-top box. The multitasking operating 
system of the set-top box addresses the high-performance demands of media-centric, real-time 
applications being delivered through a set-top box. The operating system provides an open, 
scalable platform for developing and delivering multimedia content to consumers across 
broadcast and client/server networks. The software architecture for the operating system 
includes layers of interconnected modules designed to minimize redundancy and optimize 
multimedia processing in an interactive, network setting. The layers of the architecture include 
a hardware abstraction layer 40, a core layef 42, an application support layer 44 and an 
application layer 46. 

Each hardware device associated with the multimedia client is abstracted into a software 
device module that resides in the hardware abstraction layer 40. Each of these device modules 
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are responsible for media delivery and manipulation between a hardware device and the 
remainder of the operating system. Application program interfaces (APIs) supported by each 
device module separate the hardware dependencies of each device from the portable operating 
system facilities, and thereby mask the idiosyncrasies of different hardware implementations. 

A kernel 48 and memory manager 50 residing in the core layer 42 provide the base 
functionality needed to support an application. A fully preemptive, multithreaded, multitasking 
kernel is designed to optimize both set-top memory footprint and processing speed. Since the 
operating system resides on consumer units, it has been designed to exist in a ROM-based 
system with a very small footprint (e.g., 1 -megabyte). In addition, the kernel has also been 
created to take advantage of 32-bit Reduced Instruction Set Computer (RISC) processors which 
enable high-speed transmission, manipulation and display of complex media types. 

Memory manager 50 provides an efficient allocation scheme to enable the best 
performance from limited memory resources. Memory manager 50 provides an efficient 
memory allocation scheme, enabling optimal performance from limited set-top memory 
resources. Memory manager 50 prevents applications from running out of memory by 
enabling the sharing of relocateable, purgeable memory. Memory manager 50 is provided 
to manage the allocation and purging of video memory used by such graphic applications $s 
a line drawing graphic application included within application support layer 44. Within the 
present invention, it should be understood that the terms graphic and video are used 
interchangeably. 

The core layer 42 provides an integrated event system 52 and a standard set of ANSI 
C utility functions. Built on top of the core layer 42 is an application support layer 44. This 
set of support modules provides higher-level processing functions and application services. 
Application management, session management, and tuner management are a few examples of 
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these services. At the highest application level 46, at least one application, referred to as a 
resident application is usually always executing on a set-top box. The application level 46 also 
provides the necessary capabilities for authoring applications and for managing resources (e.g., 
the tuner) between the resident application and other background applications residing on the 
set-top box. 

Figure 3 depicts a graphic application 100 requiring a certain amount of video 
memory from heap 102 in order to perform a graphic operation. Graphic application 100 
operates within the context of a two heap system: a first heap 101 for use by the central 
processing unit 103; and a second heap 102 for use by graphic application 100 and graphic 
processor 105. The preferred embodiment of the present invention is used within a system 
which has two frame buffers. One frame buffer is what is actually visible and other frame 
buffer is where graphical operations are proposed (e.g., drawing text and lines wherein it is 
desirable not to let the user see these operations). Also, the preferred embodiment includes 
graphic memory 102 which is not connected to the CPU 103 but to graphic processor 105. 

Graphic application 100 allocates memory by invoking video memory allocator 104. 
Graphic application 100 specifies the heap from which to allocate the memory as well as the 
size of the memory needed. Video memory allocator 104 returns a handle to the newly 
allocated memory. Video memory allocator 104 also initializes the memory to zeros. 
Handles are also sharable among application threads and between applications as shown by 
block 105. Handles allow memory portions to be rearranged and resized. 

Video memory allocator 104 provides the following information to a graphic 
application: the heap from which memory associated with the specified handle was allocated; 
the size of the memory associated with a specified handle; and whether a specified handle is 
valid. 
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Video memory allocation also provides heap integrity verification. Free memory is 
preferably filled with a pattern. As one of the memory management tasks it performs when 
verifying a heap's integrity, memory manager checks that the pattern in free memory has not 
been altered. Unlike a heap, whose overhead is allocated from the heap itself, the overhead 
associated with a handle is allocated in addition to the memory specified by video memory 
allocator 104. 

Video memory allocator 104 utilizes a novel video memory handling data structure 
106 in order to associate handles with portions of video memory. Video memory handling 
data structure 106 provides the mechanism by which the video manager 50 can rearrange 
memory portions (which are also known in the art as "data chunks'*) in order to provide to 
graphic application 100 the amount of memory it needs. 

In the preferred embodiment, video memory compactor 108 reallocates 
(shifts/compacts) via handles video memory portions in order to satisfy a request for a certain 
amount of video memory. For example, video memory compactor 108 can shift first memory 
portion 114 via its handle so that first video memory portion 114 is reallocated with respect 
to second video memory 116. Such a reallocation may constitute sufficient video memory 
to satisfy the memory requirement of graphic application 100. Because compaction takes 
time, a heap does not preferably automatically compact itself by default. In an alternative 
embodiment, video memory compactor 108 can shift first memory portion 114 via its handle 
so that first video memory portion 114 is reallocated to be contiguous with second video 
memory 116. 

Applications move data from one heap video memory portion to another by invoking 
video memory compactor 108. The memory handle itself does not move; only the data . 
associated with the handle moves. Moreover, an application can resize a memory portion 
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associated with a specified handle. 

If after compaction a sufficient amount of memory is still not available as determined 
by video memory sufficiency determinator 109, then the present invention uses video 
memory purger 110 and video memory handling data structure 106 to purge handles 
beginning with the handles with lower priority numbers. The memory associated with a 
handle cannot be purged in the preferred embodiment if the handle is locked. 

Before using a purgeable handle, it is preferable to verify that it still exists. An 
application sets a handle as purgeable by indicating as such to video memory purger 110 
which then updates video memory handling data structure 106 accordingly. 

A handle's purge priority defines the importance of the handle's memory relative to 
all allocated memory. In the preferred embodiment, priority ranges from zero to fifteen, 
inclusive, with the default purge priority of a handle set to four. The lower a handle's purge 
priority, the more likely it is that the memory associated with the handle will be purged. 

The preferred embodiment of the present invention allows a handle's default priority 
to be modified by a graphic application. Also, applications can explicitly purge memory by 
passing the handle to the memory to be purged and obtaining in return from video memory 
purger 110 a boolean that indicates the function's success or failure. 

A handle locking mechanism 112 is provided to manage the locking and unlocking 
of a handle and to maintain a running lock count. To ensure that memory is not moved, 
purged, or accessed while a graphic application is using it, handle locking mechanism 112 
provides applications with the ability to lock the handle associated with the memory. A 
graphic application locks a handle by passing the handle to be locked to handle locking 
mechanism 112. Preferably, the graphic application unlocks the handle upon completion of 
the operation. 
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Nested locks occur when more than one application, or application thread, utilizes 
handle locking mechanism 112 with the same handle. Handle locking mechanism 112 
maintains a lock count for this situation, the value of which can be retrieved by graphic 
applications from handle locking mechanism 112. The handle lock count represents the 
number of locking function calls that have been made on the specified handle. For each 
function call to handle locking mechanism 112 to unlock the handle, the lock count is 
decremented by one. 

Video memory allocator 104 also provides for deleting a handle. Deletion of a handle 
is different from purging a handle. Whereas purging a handle deletes only the data to which 
the handle refers, deleting a handle deletes both the data to which the handle refers as well 
as the handle itself. Also, unlike a purged handle, once a handle is deleted, it cannot be used 
anymore. An application that references a deleted handle will cause memory manager 50 to 
produce an exception. Preferably, applications delete handles of all sizes, even 0 (zero), 
when they are no longer needed. 

Figure 4 depicts the preferred embodiment for the novel video memory handling data 
structure 106 which is used to keep track of allocations to heap video memory. Video 
memory handling data structure 106 includes an identification data field 150. Preferably, 
identification data field 150 is sixteen bits in length and is formatted as two ASCII characters 
so that a heap can be examined and determined at a glance what kind of data chunks exist: 
"HC" for handle chunk; "DC" for data chunk; or "PC" for pointer chunk. 

Lock count field 152 stores the count for how many times a handle has been locked. 
When the count is zero, the handle is unlocked and the data chunk portion can be moved 
around to accommodate other allocations. The lock count is preferably an integer, which 
allows the handle to be locked multiple times as long as the computer-implemented processes 
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which lock it also unlock it when the processes are done. 

With respect to purge priority field 154, if the memory manager runs out of memory 
during an allocation, it purges purgeable handles by order of the priority stored in purge 
priority field 154. This approach allows the memory manager to choose whether the data in 
a handle is easy to recreate, but convenient to have around if there is plenty of memory (low 
priority) or difficult to recreate, but purgeable if an urgent need exists for memory as in the 
situation when a user has tuned an MPEG digital video channel. 

Purgeable field 156 indicates whether the handle is purgeable (i.e., a handle is 
purgeable if the handle is not locked). Sharable field 158 indicates whether the handle is 
sharable among computer processes. 

With respect to the on purgeable list field 160, when a handle which is marked 
purgeable is unlocked for the first time (i.e., the lock count goes from one to zero), the handle 
is placed on the purgeable list so when an allocation is failing, the memory manager can 
quickly determine what data chunks are candidates for purging. If a handle is already 
unlocked, and "unlock" is called again, this flag prevents memory manager from having to 
check the purgeable list to see if the handle is already on it. With respect to locking a locked 
handle, this flag prevents memory manager from searching the list and trying to remove the 
handle from it again. 

Heap field 164 is a reference back to the heap that contains the data chunk of the 
handle. Size field 166 is a size in bytes of the data chunk. This field is used to determine 
where the r^xt data chunk starts and to determine if an open spot in memory is large enough 
to move this data chunk to when shifting memory portions around for heap compaction. 

Pointer to the data chunk field 168 is the pointer to the actual data for which the 
handle is keeping track. Pointer to the purgeable list 170 is the list of handles, which are 
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marked purgeable and are unlocked. The cbfunc field 170 provides the call back function 
pointer for a handle. The user data field 172 is provided for arbitrary user data of the handle. 



Figures 5a-5d depict an example of the preferred implementation of the video 

5 memory handling data structure 1 06 of Figure 4. 

Figure 6 depicts the process steps associated with video memory handling. Start 
indication block 230 indicates that process block 234 is to be executed. Process block 234 
indicates that a graphic application requires a certain amount of graphic memory and requests 
the memory from the memory manager. 

0 Since memory manager keeps track of both allocated and free memory via memory 

handling data structure, memory manager at process block 235 attempts to allocate available 
video memory (preferably, but not limited to, contiguous video memory) using the memory 
handling data structure. In the preferred embodiment, memory manager utilizes two memory 
allocation algorithms: first fit and best fit. By default, it uses the first fit algorithm. 

5 For the first fit memory allocation scheme as indicated by process block 236, memory 

manager traverses its list of free memory and chooses the first piece of memory that satisfies 
the allocation request. The best fit memory allocation scheme as indicated by process block 
237 involves the system traversing its entire list of free memory to find the piece of memory 
closest to the size of the allocation request. Once a heap exists, an application can choose 

) which of these memory allocation algorithms it prefers the memory manager to use in 
managing that heap. This preferred approach provides for the use of different algorithms 
depending on an application's use of memory, the type of the set-top, the size of the set-top's 
memory, and the speed of the set-top's central processing unit (CPU). 

Decision block 238 inquires whether sufficient video memory exists to handle the 

10 
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graphic applications request without "shifting" graphic memory portions via handles or 
without purging being required. If sufficient memory already exists, then processing 
terminates at end block 270. However, if there is not sufficient video memory, processing 
continues at process block 242. 

At process block 242, memory manager reallocates video memory using handles 
stored in the novel memory handling data structure. The memory manager at decision block 
246 then inquires whether sufficient video memory exists for handling the graphic 
applications video memory requests. If a sufficient amount does exist, then processing 
terminates at end block 270. If sufficient video memory does not exist, then processing 
continues at process block 250. 

At process block 250, the memory manager purges handles starting with those 
marked purgeable and with the lowest purge priorities. If sufficient video memory is 
available as determined by decision block 254, then processing terminates at end block 270. 
However, if sufficient memory is not available even after the purging process, then process 
block 258 disables foreground on-screen display, and process block 262 unlocks the frame 
buffer. Process block 266 sends an event to all applications with a request to free up any 
video memory with which they are currently associated. Processing terminates at end block 
270 with the result that a sufficient video memory amount has been provided to the graphic 
application. 

Figures 7-10 describe the heap memory utilized in the preferred embodiment of the 
present invention. With reference to Figure 7, memory manager enables a unified memory 
system comprised of two primary heaps: system memory heap 300 and video memory heap 
304. Allocating memory from the video memory heap 304 ensures that whatever data is 
stored there is accessible to the video card and can, therefore, be displayed on the screen. 

11 
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Applications are given the opportunity to specify from which heap they wish to allocate 
memory. If they do not specify a preference, the operating system makes the decision for 
them. 

With reference to Figure 8, a heap contains both managed memory 310 and 
unmanaged memory 314. Managed memory 310 is memory that has been allocated. In 
contrast, unmanaged memory 314 is memory that has not been allocated. A heap's break 318 
separates managed memory 310 from unmanaged memory 314. 

With reference to Figure 9, managed memory 310 is divided into blocks (e.g., block 
320), and blocks into chunks (e.g., chunk 324). Each block, which consists of one or more 
contiguous chunks of memory, is owned by an application. For example, first application 
owns block 320. 

The first time that an application allocates a pointer or handle, the system reserves a 
block of memory for that application from which it allocates the requested pointer or handle 
and from which it makes future allocations for that application. If an application allocates 
a very small (usually thirty-two bytes or less) amount of memory, that allocation is made 
from a small, fixed size block. Otherwise, blocks and chunks are not typically of a 
predetermined size. 

In the preferred embodiment, memory manager supports memory management units 
(MMUs), which map an application's logically-contiguous memory addresses with real, 
physical memory addresses. The way in which a heap is organized enables memory manager 
to meet an MMUs' alignment requirements - which provide hardware enforcement of 
memory ownership - by ensuring that its blocks reside in those alignments. 

Memory manager preferably does not own any heaps. Rather, the operating system 
creates the system and video memory heaps at initialization time by specifying the memory 

12 
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address that marks the start of the heap as well as the size. This function returns a pointer to 
the newly created heap. 

Typically, applications do not create their own heaps which are called sub-heaps 
within the field of the present invention. Typically, applications allocate pointers and 
5 handles, referencing either of the heaps created by the system. 

Sub-heaps reduces fragmentation as well as contention for memory among 
applications. Memory manager provides support for sub-heaps (and sub-heaps within sub- 
heaps), which are allocated from the system heap, owned by the applications that create them, 
and maintained by memory manager. For example, as shown in Figure 1 0, memory manager 
1 0 creates heap overhead 328 and sub-heap 332 from block 336. 

An application first allocates memory from the system heap in order for a sub-heap 
to be created by calling the memory manager. The memory manager returns a reference to 
the new sub-heap. 

To delete a sub-heap, an application invokes memory manager to delete the heap and 
1 5 then to delete the pointer or the handle to the deleted heap. Memory manager then returns 
the portion of memory previously occupied by the sub-heap to the system or video heap from 
which it was allocated. Preferably, applications should not delete the system and video 
heaps. 

The overhead required to maintain a heap (or a sub-heap) is allocated from the heap 
20 itself. This preferred approach signifies that the amount of allocateable heap space is equal 
to the size of the heap minus the overhead necessary to maintain the heap. The memory 
manager determines the amount of overhead necessary to maintain a heap of a specified size. 

Memory manager is responsible for managing most, if not all, heaps, whether created 

13 
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by the system or by applications. Heap management involves keeping track of both the 
memory ranges that exist and any special attributes they might have. 

The embodiments which have been set forth above were for the purpose of illustration 
and were not intended to limit the invention. It will be appreciated by those skilled in the art 
that various changes and modifications may be made to the embodiments discussed in this 
specification without departing from the spirit and scope of the invention as defined by the 
appended claims. 



14 



WO 00/40004 
It Is Claimed: 



PCI7US99/30245 



1 . A video memory handling system for providing a graphic computer- 
implemented process with a predetermined amount of video memory to be used by said 
graphic process to perform a predetermined graphic-related operation within a set-top box 
environment, comprising: 

first video memory portion having an allocation status with respect to said graphic 
process; 

a video memory handling data structure for indicating the allocation status of said 
first video memory portion; 

a video memory manager connected to said video memory handling data structure 
for reallocating said first video memory portion based upon said video memory handling 
data structure; 

said reallocated first video memory portion being utilized by said graphic process 
to perform said predetermined graphic-related operation. 

2. The video memory handling system of Claim 1 wherein said video memory 
handling data structure includes a handle associated with said first memory portion, said 
handle being utilized by said video memory manager to reallocate said first video 
memory portion. 
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3. The video memory handling system of Claim 1 wherein a first graphic 
computer-implemented process requires a predetermined amount of video memory to 
perform a predetermined graphic-related operation, 

wherein a second graphic computer-implemented process requires a 
predetermined amount of video memory to perform a predetermined graphic-related 
operation; 

said video memory handling data structure including a first purge priority 
associated with said first video memory allocation, 

said video memory manager purging said first video memory allocation based 
upon said first purge priority, 

said first video memory being reallocated to said second process. 

4. The video memory handling system of Claim 3 wherein said memory manager 
utilizes a memory allocation fit means to allocate video memory to said graphic process 
before reallocating said first memory portion. 

5. The video memory handling system of Claim 1 wherein said memory manager 
utilizes a memory allocation fit means to allocate video memory to said graphic process 
before reallocating said first memory portion. 

6. The video memory handling system of Claim 5 wherein said predetermined 
memory allocation means being selected from the group consisting of first fit means, best 
fit means and combinations thereof. 

16 
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7. The video memory handling system of Claim 5 further comprising: 

a video memory sufficiency determinator for determining whether sufficient video 
memory is available to said graphic process to perform said graphic-related operation, 

said memory manager being connected to said video memory sufficiency 
determinator for reallocating said first video memory portion if said video memory 
sufficiency determinator determines that insufficient video memory exists after said 
memory manager utilizes said memory allocation fit means. 

8. The video memory handling system of Claim 7 wherein said set-top box 
includes a foreground on-screen display, said foreground on-screen display being disabled 
if said video memory sufficiency determinator determines that insufficient video memory 
exists after said memory manager has reallocated said first video memory portion. 

9. The video memory handling system of Claim 7 wherein said set-top box 
includes a frame buffer, said frame buffer being unlocked if said video memory 
sufficiency determinator determines that insufficient video memory exists after said 
memory manager has reallocated said first video memory portion. 

10. The video memory handling system of Claim 7 wherein said memory manager 
sends an event to applications operating within said set-top box in order to provide a 
request to said applications to free up video memory which has been allocated to said 
applications, said memory manager providing said request when said video memory 
sufficiency determinator determines that insufficient video memory exists after said 
memory manager has reallocated said first video memory portion. 
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1 1 . The video memory handling system of Claim I wherein said video memory 
handling data structure includes a lock field for indicating when said graphic process is 
performing said predetermined graphic-related operation. 

5 12. The video memory handling system of Claim 1 wherein a first and second 

graphic computer-implemented process are to respectively perform first and second 
predetermined graphic-related operations, said first and second process using a third video 
memory portion to perform their respective graphic-related operations, 

said video memory handling data structure including a lock count for indicating 
1 0 when said first and second graphic processes are performing said respective first and 
second graphic-related operations. 

13. The video memory handling system of Claim 12 wherein said video memory 
manager increments said lock count when said first graphic process is performing its 

1 5 respective graphic-related operation, said video memory manager incrementing said lock 
count when said second graphic process is performing its respective graphic-related 
operation. 

14. The video memory handling system of Claim 13 wherein said video memory 
20 manager decrements said lock count when said first graphic process has completed its 

respective graphic-related operation, said video memory manager decrementing said lock 
count when said second graphic process has completed its respective graphic-related 
operation. 



18 



WO 00/40004 PCT/US99/30245 

15. A video memory handling method for providing a graphic computer- 
implemented process with a predetermined amount of video memory to be used by said 
graphic process to perform a predetermined graphic-related operation within a set-top box 
environment, said set-top box having a central processing unit and a graphic processor, 

5 comprising the steps of: 

providing a first heap for use by said central processing unit (CPU); 
providing a second heap for use by said graphic processor; 
providing a first video memory portion within said second heap having an 
allocation status with respect to said graphic process; 
0 providing a video memory handling data structure for indicating the allocation 

status of said first video memory portion; 

providing a video memory manager connected to said video memory handling 
data structure for reallocating said first video memory portion based upon said video 
memory handling data structure; 
5 said reallocated first video memory portion being utilized by said graphic process 

to perform said predetermined graphic-related operation. 

1 6. The method of Claim 1 5 further comprising the steps of: 
providing a handle within said video memory handling data structure; 

0 associating said handle with said first video memory portion; 

reallocating said first video memory portion via said handle so that said first 
memory portion is usable by said first video memory portion. 
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17. The method of Claim 15 wherein a first graphic computer-implemented 
process requires a predetermined amount of video memory to perform a predetermined 
graphic-related operation, further comprising the steps of: 

allocating a second graphic computer-implemented process to a second video 
5 memory portion via said video memory handling data structure so as to produce a first 
video memory allocation; 

providing a first purge priority within said video memory handling data structure; 
associating said first purge priority with said first video memory allocation; 
purging said first video memory allocation based upon said first purge priority; 

10 and 

reallocating said first video memory portion to said second process. 

18. The method of Claim 17 further comprising the steps: 

allocating a third graphic computer-implemented process to a fourth memory 
15 portion via said video memory handling data structure so as to produce a second video 
memory allocation; 

providing a second purge priority within said video memory handling data 
structure; 

associating said second purge priority with said second video memory allocation, 
20 said first and second purge priorities having levels which are indicative of the degree of 
priority; 

purging said first video memory allocation based upon said first purge priority 
being of a lower priority than said second purge priority; and 

reallocating said first video memory to said second process. 
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1 9. The method of Claim 1 5 further comprising the step of: 
allocating via a memory allocation fit mechanism video memory to said graphic 
process before reallocating said first memory portion. 



5 20. The method of Claim 1 9 wherein said predetermined memory allocation 

mechanism is selected from the group consisting of first fit means, best fit means and 
combinations thereof. 



21. The method of Claim 19 further comprising the steps of: 

1 0 determining whether sufficient video memory is available to said graphic process 

to perform said graphic-related operation; and 

reallocating said first video memory portion if said video memory sufficiency 
determinator determines that insufficient video memory exists after said memory manager 
utilizes said memory allocation fit means. 

15' 

22. The method of Claim 19 wherein said set-top box includes a foreground on- 
screen display, said method further comprising the step of: 

disabling said foreground on-screen display if insufficient video memory exists 
after reallocating said first video memory portion. 

20 

23. The method of Claim 21 wherein said set-top box includes a frame buffer, said 
method further comprising the step of: 

unlocking said frame buffer if insufficient video memory exists after reallocating 
said first video memory portion. 
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24. The method of Claim 21 further comprising the step of: 

sending an event to applications operating within said set-top box in order to 
request said applications to free up video memory which has been allocated to said 
applications, said event being sent if insufficient video memory exists after reallocating 
said first video memory portion. 

25. The method of Claim 15 further comprising the step of: 

providing a lock field within said video memory handling data structure for 
indicating when said graphic process is performing said predetermined graphic-related 
operation. 

26. The method of Claim 15 further comprising the steps of: 

performing first and second predetermined graphic-related operations using a third 
video memory portion; and 

providing a lock field within said video memory handling data structure for 
indicating when said first and second graphic operations are being performed and when 
said first and second graphic operations have been completed. 

27. The method of Claim 26 further comprising the steps of: 

incrementing said lock count when said first graphic operation is being performed; 

and 

incrementing said lock count when said second graphic operation is being 
performed. 
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28. The method of Claim 27 further comprising the steps of: 
decrementing said lock count when said first graphic operation has completed; and 
decrementing said lock count when said second graphic-related operation has 
completed. 



23 



WO 00/40004 



PCT/US99/30245 



1/11 




WO 00/40004 



PCT/US99/30245 



46 



Packager 



Applications 



Authoring 
Runtimes 



Resident 
Application 



44 



\ 



2/11 



Application Manager 



Audio Player 



BootLoader 



Capture 



Front Panel Display Manager 



Graphics Subsystem 



Internationalisation Manager 



List Manager 



MPEG Transport 



Persistent Storage Manager 



PowerDraw 



PowerLoader 



Purchase Manager 



Resource Manager 



Screen Manager 



Selector 



Serial Manager 



Service Manager 



Session Manager 



Stream Manager 



TCP/UDP-IP Sockets 



TV Manager 



Window Manager 



FIG. 2 



^42 



Kernel 



Events 



Memory 
Manager 



if 



Hardware 
Abstraction 
Layer 



52 



^50 



WO 00/40004 



PCT/US99/30245 



3/11 




FIG. 3 



WO 00/40004 



PCT/US99/30245 



4/11 




B)BQ J9Sf| 9J8|aQ 




CM 



V 



2 



B 

Q 
0) 

w 



to 
o 



FIG. 4 




FIG. 5a 



WO 00/40004 



PCT/US99/3024S 



6/11 



I 

U 

2 



-3 73 



T3 w 

3 | 

9 .1 

I 1 



J2 

U 

o 

JO 

o 

e 

V 

a 
s 

o 

4? 

3 

u 

1 



C 
O 



c 
o 



«9 

E 
8 

o 
o. 

J 



"is 
.B 



b 

•B 
o 



*T3 

O 
bo 
.5 
t3 



a. 
8 



o 

V 
N 



3 J2 

! * 



C 
EX 



o 



.2 x 



.S 

w 

5 



J* 
.3 
•S 



I 



M zz 



2 « S5 

« ? -s 

n .£? "2 

'v> jq 



O 



00 
D. 

s 

E 



(N 



1 I 8 



O 



00 
OA 

■c 

o 



- . "8 "8 
§> .6 & & 



.a 



.8 

o 



.8 



.8 

00 



<N <N V© 

m -—I 



00 

.3 



if 



oo 

"3 



8 
5 



E 

s 



oo 

8- 

S3 



E 



FIG. 5b 



WO 00/40004 



PCT/US99/30245 



7/11 



J 



03 



•5 



8 

o 

C 



c 

3 

o 



° S 

<u ^ 

03 ^ 

i. 4 

if "P 



.a 



o 

.a 



u 
o 



S 3 



S 

o 

'13 
CX 



a. 



i3 -a 



c 

o 



B 

s 



w 
6 



.5 



■6 



FIG. 5c 



WO 00/40004 



PCT/US99/30Z45 



8/11 




in 

+-* JO 



-4 



a. 



3 

o 



T3 



6 
2 



(N 



a 

I 

OJ 



E 



I, 

E 

2 



FIG. 5d 



WO 00/40004 



PCT/US99/30245 



9/11 



230 
234 



236 



First Fit 



Best Fit 



1 


r 




Graphic 
Application 
Requires A Certain 
Amount Of Video 
Memory 






r 


N 


Allocate Available 
Contiguous Video 

Memory Using - 
Memory Handling 

Data Structure 



237 



242 



246 



250 



Memory Manager 
Reallocates Video 

Memory Using 
Handles Stored In 
Memory Handling 

Data Structure 



254 



235 







262 



266 





No 

r 


Disable 
- Foreground On- 
screen Display 






Unlock Frame 
Butter 






Send An Event To 

All Applications 
Requesting Them 
To Free Up Video 
Memory 







( End > 



Yes 



Memory Manager 
Purges Handles 
Starting With 
Those Marked 
Purgeable And 

With The Lowest 
Purge Priorities 



270 



FIG. 6 



WO 00/40004 



PCT/US99/3024S 



10/11 



Mem_Heap 



Mem_Heap 



> 






Heap Struct 


System memory heap 




> 


Heap Struct 


Video memory heap 





300 



304 



FIG. 7 



Mem_Heap- 



> 






Managed memory 


Unmanaged memeory 





310 
318 

< — ^ Break 



314 



FIG. 8 



WO 00/40004 



PCT/US99/30245 



11/11 



MemJHeap - 
Mem_BIock- 

Mem Block - 



Mem_Block- 
Mem_Chunk- 
Mem Chunk- 



" T 

> 


Heap Struct 


> 


Block #1 ^ 


> 


Block #2 






> 

> 


Block #3 









-310 
^320 

Owned by application #1 
Owned by application #2 

324 



FIG. 9 



System heap 



System heap 



Block #1 



Block #2 



Block #1 



Heap overhead 



Sub-heap 



Result of mem_NewPointer 
"336 



\ 



-328 



Sub-heap created as a result 
of mem_NewHeap 

—-332 



FIG. 10 



INTERNATIONAL SEARCH REPORT 



Inten nil Application No 

PCT/US 99/30245 



A, CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04N5/00 



AcoortJing to Intsmational Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N G09G G06F 



Documentation searched other than minimum documentation to the extent that such documents are Included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to ofaim No. 



p.x 



WO 99 18730 A (CANAL PLUS SA ;LIA0 H0NGTA0 
(FR); YANG RUI LIANG (FR)) 
15 April 1999 (1999-04-15) 
page 21, line 1 -page 23, line 9 
figure 8 

EP 0 772 159 A (SGS THOMSON 
MICROELECTRONICS) 7 May 1997 (1997-05-07) 
page 4, line 55 -page 7, line 12 
figures 2,3 

-/-- 



1-5, 
15-19 



1-28 



m 



Further documents are listed In the continuation of box C. 



El 



Patent family members are listed In annex. 



* Special categories of cited documents : 

'A* document defining the general state of the art which Is not 

considered to be of particular relevance 
'E* earlier document but pubflahed on or after the International 

fifing date 

L a document which may throw doubts on priority ctaim(s)or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 
*0" document referring to an oral cfectosure, use, exhibition or 
other means 

*P' document published prior to the tntematJonai filing date but 
later than the priority date claimed 



T later document published after the International filing date 
or priority date and not In conflict with the application but 
cftsd to understand the principle or theory underlying the 
Invention 

*X* document of particular relevance; the dalmed Invention 
cannot be considered novel or cannot be considered to 
Involve an Inventive step when the document 1» taken alone 

"Y* document of particular relevance; the claimed Invention 
cannot be considered to Invorve an inventive step when the 
document Is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art 

'&* document member of the same patent fam9y 



Dale of the actual completion of the International search 

15 May 2000 


Data of mailing of the international search report 

22/05/2000 


Name and mailing address of the ISA 

European Patent Office. PS. 561 8 Patentlaan 2 
NL-2280HV Rijawtyc 
Tel. (+31 -70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 


Authorized officer 

H amp son, F 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Met aial Application No 

PCT/US 99/30245 



C(C©ntlnu«t»on) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ' Citation at document, with Indteatlon.where appropriate, ol the relevant passages 



Relevant to datm No. 



VOGT C: " SP E I C HERORG AN I S ATI ON IN 
OB JEKT-OR I ENTI E RTEN SYSTEMEN-EINE 
UEBERSICHT" 

INFORMATI ONSTECHNI K I T , DE , 0LDENB0URG 
VERLAG. MUNCHEN , 
vol. 33, no. 4, 

1 August 1991 (1991-08-01), pages 208-219, 
XP000258467 

page 211, left-hand column, Hne 21 -page 
213, right-hand column, line 29 



1-28 



Fom PCT/ISAAIO (centtiucton o) Moood thm) (July 1 SSS) 



page 2 of 



2 



INTERNATIONAL SEARCH REPORT 

mfomutlon on patent frmily nrambar* 



Into jntl AppUcttlon No 

PCT/US 99/30245 



Patent document 
cited In search report 



Publication 
date 



Patent family 
members) 



Publication 
date 



U0 9918730 



15-04-1999 



EP 
EP 
EP 
AU 



0909091 A 
0909094 A 
0908821 A 
9363298 A 



14-04-1999 
14-04-1999 
14-04-1999 
27-04-1999 



EP 0772159 A 07-05-1997 FR 2740583 A 30-04-1997 

EP 0827110 A 04-03-1998 
JP 10145739 A 29-05-1998 



Form PCT/ISA/210 (pitMt famty annw) (Jury 1602) 



